System and method for voice authentication over a computer network

ABSTRACT

Systems, computer-implemented methods, and tangible computer-readable media are provided for voice authentication. The method includes receiving, on a mobile device, a speech sample from a user as part of a request for a restricted-access resource separate from the mobile device. When the user has previously established an identity with the mobile device, the method includes transmitting the speech sample along with the request to an authentication server which compares the speech sample to a previously established speech profile associated with the user and providing access to the restricted-access resource based on a response to the request from the authentication server if the speech sample from the user matches the speech profile on the authentication server with a minimum certainty threshold.

PRIORITY INFORMATION

The present application is a continuation of U.S. patent applicationSer. No. 14/537,370, filed Nov. 10, 2014, which is a continuation ofU.S. patent application Ser. No. 13/311,521, filed Dec. 5, 2011, nowU.S. Pat. No. 8,886,544, issued Nov. 11, 2014, which is a continuationof U.S. patent application Ser. No. 12/328,365, filed Dec. 4, 2008, nowU.S. Pat. No. 8,095,368, issued Jan. 10, 2012, the contents of which areincluded herewith in their entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to voice recognition and more specificallyto voice-based authentication.

2. Introduction

Many Internet and network applications require authentication forsecurity purposes, such as online banking, online auction sites, onlinedating sites, online stock brokers, webmail, and countless others.Authentication is designed to reduce or avoid fraud by allowing accessonly to approved individuals. One current solution in the art is toauthenticate based on username and password. One problem with usernamesand passwords is that users can have too many to remember easily.Another problem is that malicious people can easily steal, copy, and, insome cases, guess usernames and passwords. Even in spite of theseshortcomings, username/password combinations are very well entrenched inmany secure Internet and network-based applications. Accordingly, whatis needed in the art is a way to augment or replace currentusername/password approaches to authentication in order to reduce fraudand enhance security in network applications.

SUMMARY

Additional features and advantages of the invention will be set forth inthe description which follows, and in part will be obvious from thedescription, or may be learned by practice of the invention. Thefeatures and advantages of the invention may be realized and obtained bymeans of the instruments and combinations particularly pointed out inthe appended claims. These and other features of the present inventionwill become more fully apparent from the following description andappended claims, or may be learned by the practice of the invention asset forth herein.

Disclosed are systems, computer-implemented methods, and tangiblecomputer-readable media for voice authentication. The method includesreceiving a speech sample from a user through an Internet browser forauthentication as part of a request for a restricted-access resource,performing a comparison of the received speech sample to a previouslyestablished speech profile associated with the user, transmitting anauthentication to the network client if the comparison is equal to orgreater than a certainty threshold, and transmitting a denial to thenetwork client if the comparison is less than the certainty threshold.The user can capture and send the speech sample with a single userinput, such as a single mouse click. A computing device running theInternet browser can preauthenticate the received speech sample beforesending the speech sample to the server. The method can further includesending to the user with a prompt for an additional speech sample due tofeigned poor speech recognition if the comparison is less than thecertainty threshold, receiving the additional speech sample from theuser, performing a second comparison of the additional received speechsample to the previously established speech profile associated with theuser, and transmitting an authentication to the network client if thesecond comparison is equal to or greater than a certainty threshold.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to describe the manner in which the above-recited and otheradvantages and features of the invention can be obtained, a moreparticular description of the invention briefly described above will berendered by reference to specific embodiments thereof which areillustrated in the appended drawings. Understanding that these drawingsdepict only exemplary embodiments of the invention and are not thereforeto be considered to be limiting of its scope, the invention will bedescribed and explained with additional specificity and detail throughthe use of the accompanying drawings in which:

FIG. 1 illustrates an example system embodiment;

FIG. 2 illustrates an example method embodiment; and

FIG. 3 illustrates an example password validation flow.

DETAILED DESCRIPTION

Various embodiments of the invention are discussed in detail below.While specific implementations are discussed, it should be understoodthat this is done for illustration purposes only. A person skilled inthe relevant art will recognize that other components and configurationsmay be used without parting from the spirit and scope of the invention.

With reference to FIG. 1, an exemplary system includes a general-purposecomputing device 100, including a processing unit (CPU) 120 and a systembus 110 that couples various system components including the systemmemory such as read only memory (ROM) 140 and random access memory (RAM)150 to the processing unit 120. Other system memory 130 may be availablefor use as well. It can be appreciated that the invention may operate ona computing device with more than one CPU 120 or on a group or clusterof computing devices networked together to provide greater processingcapability. A processing unit 120 can include a general purpose CPUcontrolled by software as well as a special-purpose processor. An IntelXeon LV L7345 processor is an example of a general purpose CPU which iscontrolled by software. Particular functionality may also be built intothe design of a separate computer chip. An STMicroelectronics STA013processor is an example of a special-purpose processor which decodes MP3audio files. Of course, a processing unit includes any general purposeCPU and a module configured to control the CPU as well as aspecial-purpose processor where software is effectively incorporatedinto the actual processor design. A processing unit may essentially be acompletely self-contained computing system, containing multiple cores orCPUs, a bus, memory controller, cache, etc. A multi-core processing unitmay be symmetric or asymmetric.

The system bus 110 may be any of several types of bus structuresincluding a memory bus or memory controller, a peripheral bus, and alocal bus using any of a variety of bus architectures. A basicinput/output (BIOS) stored in ROM 140 or the like, may provide the basicroutine that helps to transfer information between elements within thecomputing device 100, such as during start-up. The computing device 100further includes storage devices such as a hard disk drive 160, amagnetic disk drive, an optical disk drive, tape drive or the like. Thestorage device 160 is connected to the system bus 110 by a driveinterface. The drives and the associated computer readable media providenonvolatile storage of computer readable instructions, data structures,program modules and other data for the computing device 100. In oneaspect, a hardware module that performs a particular function includesthe software component stored in a tangible computer-readable medium inconnection with the necessary hardware components, such as the CPU, bus,display, and so forth, to carry out the function. The basic componentsare known to those of skill in the art and appropriate variations arecontemplated depending on the type of device, such as whether the deviceis a small, handheld computing device, a desktop computer, or a computerserver.

Although the exemplary environment described herein employs the harddisk, it should be appreciated by those skilled in the art that othertypes of computer readable media which can store data that areaccessible by a computer, such as magnetic cassettes, flash memorycards, digital versatile disks, cartridges, random access memories(RAMs), read only memory (ROM), a cable or wireless signal containing abit stream and the like, may also be used in the exemplary operatingenvironment.

To enable user interaction with the computing device 100, an inputdevice 190 represents any number of input mechanisms, such as amicrophone for speech, a touch-sensitive screen for gesture or graphicalinput, keyboard, mouse, motion input, speech and so forth. The input maybe used by the presenter to indicate the beginning of a speech searchquery. The device output 170 can also be one or more of a number ofoutput mechanisms known to those of skill in the art. In some instances,multimodal systems enable a user to provide multiple types of input tocommunicate with the computing device 100. The communications interface180 generally governs and manages the user input and system output.There is no restriction on the invention operating on any particularhardware arrangement and therefore the basic features here may easily besubstituted for improved hardware or firmware arrangements as they aredeveloped.

For clarity of explanation, the illustrative system embodiment ispresented as comprising individual functional blocks (includingfunctional blocks labeled as a “processor”). The functions these blocksrepresent may be provided through the use of either shared or dedicatedhardware, including, but not limited to, hardware capable of executingsoftware and hardware, such as a processor, that is purpose-built tooperate as an equivalent to software executing on a general purposeprocessor. For example the functions of one or more processors presentedin FIG. 1 may be provided by a single shared processor or multipleprocessors. (Use of the term “processor” should not be construed torefer exclusively to hardware capable of executing software.)Illustrative embodiments may comprise microprocessor and/or digitalsignal processor (DSP) hardware, read-only memory (ROM) for storingsoftware performing the operations discussed below, and random accessmemory (RAM) for storing results. Very large scale integration (VLSI)hardware embodiments, as well as custom VLSI circuitry in combinationwith a general purpose DSP circuit, may also be provided.

The logical operations of the various embodiments are implemented as:(1) a sequence of computer implemented steps, operations, or proceduresrunning on a programmable circuit within a general use computer, (2) asequence of computer implemented steps, operations, or proceduresrunning on a specific-use programmable circuit; and/or (3)interconnected machine modules or program engines within theprogrammable circuits.

Having disclosed some basic system components, the disclosure turns tothe exemplary method embodiment for voice authentication as illustratedin FIG. 2. For clarity, the method is discussed in terms of a systemconfigured to practice the invention. The system receives a speechsample from a user through an Internet browser for authentication aspart of a request for a restricted-access resource (202). The system canreceive the speech sample via Voice over IP (VoIP). The user can captureand send the speech sample with a single user input, such as a singlemouse click, finger tap, or shaking a device with an accelerometer. Onescenario is a user logging in to a secure online banking site. When theuser logs in, the system includes a speech field in addition to or as areplacement for a traditional username and password field. Next to theusername and password text fields, the website displays a speech inputfield. The user can click a button or click in the speech input field toenter a speech sample using a microphone. Such a website can becompatible with nearly any Internet-connected device having amicrophone, such as a personal computer, PDA, or smartphone. The websitetransmits the speech sample to the system over a single communicationschannel, the Internet, rather than using two separate channels, such asthe Internet and a separate phone line. The user can say his passwordand/or username aloud to generate the speech sample. The user can alsoread a specified text to generate the speech sample. After the systemreceives the speech sample, the system performs a comparison of thereceived speech sample to a previously established speech profileassociated with the user (204). In the online banking example,establishing a speech profile can be part of setting up an account. Thesystem transmits an authentication to the network client if thecomparison is equal to or greater than a certainty threshold (206). Thesystem transmits a denial to the network client if the comparison isless than the certainty threshold (208).

In one variation, the computing device running the Internet browserpreauthenticates the received speech sample before sending the speechsample to the server. The preauthentication can be more relaxed than theserver authentication. One reason for this is that a mobile device, forexample, has only very modest computing power and may not be able toquickly and accurately perform speech matching to a speech profile. Inother situations, the system can make a decision to preauthenticatebased on network conditions. For example, if the system detectsdisruptions in the network connection, it can allow preauthentication onthe computing device to conserve or delay bandwidth use.

In one aspect, a received user token must match a previously establisheduser token before the system transmits the authentication to the networkclient. The user token can be a username and/or password combination, anidentification card, a USB authentication device, an iris scan, afingerprint, or other authentication token. The system can authenticatethe token first before authenticating the speech.

In one variation, the system attempts to resolve poor speech recognitionattempts by sending to the user with a prompt for an additional speechsample due to feigned poor speech recognition if the comparison is lessthan the certainty threshold, receiving the additional speech samplefrom the user, performing a second comparison of the additional receivedspeech sample to the previously established speech profile associatedwith the user, and transmitting an authentication to the network clientif the second comparison is equal to or greater than a certaintythreshold. An illustration of this is a user who provides a speechsample to the system. The system cannot authenticate the speech sample,but determines that the speech sample is close to the minimum threshold.The system can act as if the speech sample was garbled or not properlyreceived and prompt the user for a second sample that is clearer,slower, or louder. The system can then compare the second speech sampleand authenticate the user if the second speech sample is above thethreshold. Such situations can occur due to the natural variations ofhuman voices. For instance, if the user's initial speech sample wasrecorded while the user had a frog in his throat, the recognition maynot succeed. However, after the user clears his throat and sends asecond speech sample, the system can successfully authenticate the user.

FIG. 3 illustrates an example password validation flow. The user firstsends his voice to get access to Internet or intranet secured content300. The user can send his voice via a phone call or as an integratedpart of a web browser. For example, a website can include a button nextto the traditional username and password fields which allows the user toeasily capture and transmit a voice sample to a validation server. Thesystem sends the voice over IP to a server for validation 302. AlthoughVoIP is one common voice transport protocol, the system can user otherprotocols as well. The server stores a voice ID 304 based on thereceived voice sample from the user. The server recognizes 306 thespeech and attempts to match it to a previously built voice ID 308. Theserver passes results back to the system. The system determines if thevoice was recognized and if the voice was authenticated 310. The systemperforms these checks to verify that the voice belongs to a recognizedperson and to verify that the recognized person has authority orpermission to access restricted content. If these checks are notsatisfied, the system denies access 312. If these checks are satisfied,the system grants access 314. Some examples of restricted accessresources are an online banking website, a stock trading website, anonline photo album, a blog, or a website administration page.

In one aspect, when the system encounters a voice it cannot initiallyauthorize, the system feigns a bad voice recognition result and requestsa second voice sample. For example, if the system prompts the user tosay “Swordfish”, but the voice sample from the user is notauthenticated, the system can further prompt the user “Sorry, I didn'tunderstand your request. Please say ‘Swordfish’ again.” The system doesnot inform the user that the voice-based authorization failed, but stillgathers a second voice sample. Often, due to the feigned prompt, theuser will speak more clearly or slowly for the second voice sample. Thesystem can then attempt a second authorization based on the second voicesample.

The principles described herein can operate in a mobile computingcontext using WiMAX, EDGE, or 3G for network communications. The systemcan communicate voice using Voice over XML to support input and outputof voice over the same channel as HTTP requests. In this way, the usercan occupy only a single channel, the Internet, for day to daytransactions instead of two channels such as the Internet and a phoneline.

In one aspect, the system prompts the user to utter a specific keywordwhich can either be static or dynamic. The system can prompt the user tosay a word displayed on the screen or a username, for example. Thesystem can prompt the user to utter the keyword without displaying aprinted version of the word on a screen. For example, the system canprompt the user “What is your birth month?” or “What is your mother'smaiden name?” The user can click a button and say the requested keyword.In one embodiment, the system applies speech recognition to transcribethe user utterance and populate a speech recognition field or otherwisedisplay the speech recognition result.

Embodiments within the scope of the present invention may also includecomputer-readable media for carrying or having computer-executableinstructions or data structures stored thereon. Such computer-readablemedia can be any available media that can be accessed by a generalpurpose or special purpose computer, including the functional design ofany special purpose processor as discussed above. By way of example, andnot limitation, such computer-readable media can comprise RAM, ROM,EEPROM, CD-ROM or other optical disk storage, magnetic disk storage orother magnetic storage devices, or any other medium which can be used tocarry or store desired program code means in the form ofcomputer-executable instructions, data structures, or processor chipdesign. When information is transferred or provided over a network oranother communications connection (either hardwired, wireless, orcombination thereof) to a computer, the computer properly views theconnection as a computer-readable medium. Thus, any such connection isproperly termed a computer-readable medium. Combinations of the aboveshould also be included within the scope of the computer-readable media.

Computer-executable instructions include, for example, instructions anddata which cause a general purpose computer, special purpose computer,or special purpose processing device to perform a certain function orgroup of functions. Computer-executable instructions also includeprogram modules that are executed by computers in stand-alone or networkenvironments. Generally, program modules include routines, programs,objects, components, data structures, and the functions inherent in thedesign of special-purpose processors, etc. that perform particular tasksor implement particular abstract data types. Computer-executableinstructions, associated data structures, and program modules representexamples of the program code means for executing steps of the methodsdisclosed herein. The particular sequence of such executableinstructions or associated data structures represents examples ofcorresponding acts for implementing the functions described in suchsteps.

Those of skill in the art will appreciate that other embodiments of theinvention may be practiced in network computing environments with manytypes of computer system configurations, including personal computers,hand-held devices, multi-processor systems, microprocessor-based orprogrammable consumer electronics, network PCs, minicomputers, mainframecomputers, and the like. Embodiments may also be practiced indistributed computing environments where tasks are performed by localand remote processing devices that are linked (either by hardwiredlinks, wireless links, or by a combination thereof) through acommunications network. In a distributed computing environment, programmodules may be located in both local and remote memory storage devices.

The various embodiments described above are provided by way ofillustration only and should not be construed to limit the invention.For example, the principles herein may be applied to a banking website,a social networking website, school registration website, or any otheronline application (WWW-based or otherwise) which requiresauthentication. The principles described herein can be used alone or inconcert with other authentication schemes such as a username/passwordcombination or other biometric authentication. Those skilled in the artwill readily recognize various modifications and changes that may bemade to the present invention without following the example embodimentsand applications illustrated and described herein, and without departingfrom the true spirit and scope of the present invention.

I claim:
 1. A method comprising: receiving, on a mobile device, a speech sample from a user as part of a request for a restricted-access resource separate from the mobile device; and when the user has previously established identity with the mobile device: transmitting the speech sample along with the request to an authentication server which compares the speech sample to a previously established speech profile associated with the user; and providing access to the restricted-access resource if the speech sample from the user matches the previously established speech profile with a minimum certainty threshold.
 2. The method of claim 1, wherein the user captures and sends the speech sample with a single user input.
 3. The method of claim 1, further comprising: pre-authenticating the speech sample using a lower standard than an authentication by the authentication server.
 4. The method of claim 1, further comprising: when the speech sample fails to meet a certainty threshold, prompting the user for an additional speech sample; receiving the additional speech sample from the user; performing a second comparison of the additional speech sample to the previously established speech profile; and transmitting the request to the authentication server upon the second comparison meeting the certainty threshold.
 5. The method of claim 1, wherein the speech sample is a spoken password.
 6. The method of claim 1, wherein the user reads specified text to generate the speech sample.
 7. The method of claim 1, wherein transmitting the request comprises sending a portion of the speech sample to the authentication server via voice over IP.
 8. A system comprising: a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing operations comprising: receiving, on a mobile device, a speech sample from a user as part of a request for a restricted-access resource separate from the mobile device; and when the user has previously established identity with the mobile device: transmitting the speech sample along with the request to an authentication server which compares the speech sample to a previously established speech profile associated with the user; and providing access to the restricted-access resource if the speech sample from the user matches the previously established speech profile with a minimum certainty threshold.
 9. The system of claim 8, wherein the user captures and sends the speech sample with a single user input.
 10. The system of claim 8, wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform further operations comprising: pre-authenticating the speech sample using a lower standard than an authentication by the authentication server.
 11. The system of claim 8, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising: when the speech sample fails to meet a certainty threshold, prompting the user for an additional speech sample; receiving the additional speech sample from the user; performing a second comparison of the additional speech sample to the previously established speech profile; and transmitting the request to the authentication server upon the second comparison meeting the certainty threshold.
 12. The system of claim 8, wherein the speech sample is a spoken password.
 13. The system of claim 8, wherein the user reads specified text to generate the speech sample.
 14. The system of claim 8, wherein transmitting the request comprises sending a portion of the speech sample to the authentication server via voice over IP.
 15. A non-transitory computer-readable storage device having instructions stored which, when executed by a computing device, result in the computing device performing operations comprising: receiving, on a mobile device, a speech sample from a user as part of a request for a restricted-access resource separate from the mobile device; and when the user has previously established identity with the mobile device: transmitting the speech sample along with the request to an authentication server which compares the speech sample to a previously established speech profile associated with the user; and providing access to the restricted-access resource if the speech sample from the user matches the previously established speech profile with a minimum certainty threshold.
 16. The non-transitory computer-readable storage device of claim 15, wherein the user captures and sends the speech sample with a single user input.
 17. The non-transitory computer-readable storage device of claim 15, wherein the computer-readable storage device stores additional instructions which, when executed by the computing device, result in the computing device performing further operations comprising pre-authenticating the speech sample using a lower standard than an authentication by the authentication server.
 18. The non-transitory computer-readable storage device of claim 15, having additional instructions stored which, when executed by the computing device, cause the computing device to perform further operations comprising: when the speech sample fails to meet a certainty threshold, prompting the user for an additional speech sample; receiving the additional speech sample from the user; performing a second comparison of the additional speech sample to the previously established speech profile; and transmitting the request to the authentication server upon the second comparison meeting the certainty threshold.
 19. The non-transitory computer-readable storage device of claim 15, wherein the speech sample is a spoken password. 